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1, INTRODUCTION 

Over the last decade, researchers have attempted to solve problems in engineering with the help of 
ANEFIS such as: ANFIS for tractor starter motor [1], railway wheels [2], external gear pumps [3], motor DC 
[4], robotic [5], nonlinear three-tank system [6], emissions of a diesel engine [7], automatic parking [8], 
automatic voltage regulator [9], magnetorheological damper [10], aircraft auto-landing [11], surface 
roughness in grinding process [12] and welded aluminium pipes [13], power system stabilizer [14], 
photovoltaic system [15], turbo-generators [16] and dynamic voltage restorer [17]. 

The robot manipulator control presents a major concern in robotics research at present. In the 
literature, Mehmet constructed a control of 2-DOF direct-drive robot arm based fractional fuzzy adaptive 
sliding-mode method [18], Amer et al created 3 DOF planar robot manipulators based adaptive fuzzy sliding 
mode control [19], Pierrot et al investigated a new design of a 4-DOF parallel manipulator for high-speed and 
high-acceleration pick and place operations [20], Lotfazar et al explained a dynamic equations of motion of a 
5 DoF robot manipulator based integrator backstepping method [21], Alavandar and Nigam described control 
of 6-DOF robot manipulator using Adaptive Neuro-Fuzzy Inference System [22] and Klanke et al 
constructed a dynamic path planning for a 7-DOF robot Arm [23]. In the last few years, several new design 
of robotic manipulator has been proposed [24-26]. 
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Motivated by the above, writers focused on control of the new design 5-DOF robot arm based 
Adaptive Neuro Fuzzy Inference System (ANFIS). In this study presented color object detection, inverse 
kinematic model and Adaptive Neuro-Fuzzy (ANFIS) method as machine learning based on MATLAB. 
Finally, ANFIS method will be implemented to 5 DoF robot arm to pick up and place colored object. 

The remainder of this paper is organized as follows: Section 2 presents the general system overview 
of colored object detection. Section 3 presents the color detection of the object based MATLAB. Section 4 
describes schematic and hardware of Robot Arm. The architecture of ANFIS is presented on section 5. 
Implemented ANFIS method to Robot Arm to take and place the colored object presented on section 6 and 
section 7 discusses the benefits of the studied adaptive neuro fuzzy method and conclusions are presented. 


2. SYSTEM OVERVIEW 

Figure 1 describes that the webcam detects a colored object. Next, it 1s divided into two processes: 
the first process is to create training data, consisting of the coordinates of centroid colored objects and 
collecting data of servo angle. The second process is testing the system, after obtaining the coordinates of the 
centroid colored objects, then the test data of colored objects in accordance with the trained data. Data is 
processed to obtain a servo angle based on Adaptive Neuro-Fuzzy (ANFIS) method, which is used to drive 
servo motor of Robot Arm. All processes work in real-time based on MATLAB and Arduino 
microcontroller. 
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Figure 1. General System Scheme of Colored Object Detection 
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3. COLOR DETECTION 
Webcam is a device that can be used as a sensor in detecting a colored object through image 
processing. The algorithm and inter-faces build based on MATLAB. Color detection can be done by 
transforming the image color space. The steps of red color detection using MATLAB are as follows: 
Enable original video. 
Extract each frame on the original video. 
Transform the color space that originally resides in the RGB color space into the HSV color space. 
Red segmentation of HSV color space based on H (0.8 to 1), S (0.5 to 1) and V (0.1 to 1). 
Running all frames of the processing sequentially in video form. 
The selected color object will be marked with a rectangle. 
The detection result of the colored object has the centroid coordinate position (x; y) as shown in Figure 2. 
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Figure 2. Interface of Color Detection with Coordinate 


4. HARDWARE OF ROBOT ARM 

The main component of the 5 DOF robot arm are: Arduino board, webcam, motor servo, battery, 
cables and Robot Arm hardware construction, as shown in Figure 3. The schematic of 5 DOF robot arm is 
shown in Figure 4. Robot arm has 5 servos connected to each arduino pin. Servol connect to pin 9, Servo 2 
connect to pin 10, Servo 3 connect to pin 11, Servo 4 connect to pin 12 and Servo 5 connect to pin 13. 





Figure 3. Hardware of Robot Arm 5 DOF 
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Figure 4. Schematic of Robot Arm 


5. INVERSE KINEMATIC MODEL AND ADAPTIVE NEURO-FUZZY 

This work describes the basics of ANFIS network structure and its hybrid learning rule. Motivated 
by the major idea of fuzzy logic inference procedure on a feed forward network structure, Jang [27] 
constructed a fuzzy neural network model. The adaptive neuro fuzzy inference system (ANFIS) structure is 
depicted in Figure 5. 





Figure 5. ANFIS Structure 


Kinematics studies are conversion from Cartesian coordinates (x, y, z) to the moving angle of the 
joint ( 01, 82, 83) of the mechanical Robot Arm. Kinematic classified to two part are Forward Kinematic 
(from joint angle to coordinate) and Inverse Kinematic (from coordinate to joint angle) [28]. 

In this work, the data needed for training of ANFIS is obtained from the inverse kinematics models 
of the robot arm to take and place a colored object on certain coordinate. The data consist by input data as x 
and y coordinate, and the output data of servo's angle as Servol-Servo 5 shown at Table 1. Webcam is used 
to obtain the coordinate data values from the evaluation color object detection. The video capture configure 
as 640 x 480 pixel. When objects are in certain coordinates, we will get a servo angle capable of moving to 
reach the object. Furthermore, data will be used as training data in adaptive neuro fuzzy inference system 
(ANFIS). 

Inverse kinematic model data consisting of coordinate data (x and y) of colored objects, and 5 servos 
angles with trained data (Cal = Calibration) and tested data (ANFIS = Adaptive Neuro Fuzzy Inference 
System training) are presented in Table 1. Experiment result using Adaptive Neuro Fuzzy Inference System 
shows the effectiveness of the approach in control Robot Arm to pick and place the colored object. 
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Table 1. The database of Inverse Kinematic Model to Control Robot Arm 


Coordinate Servol Servo2 Servo3 Servo4 Servo5 

x y Cal ANFIS Cal ANFIS Cal ANFIS Cal ANFIS Cal ANFIS 
107 205 113 110.998 174 168.341 50 60.4521 38 44.3076 105 105 
105 205 113 111.646 174 168.48 50 60.1876 38 44.3137 105 105 
103 207 113 112.239 174 169.507 50 58.4371 38 44.8238 105 105 
107 210 113 110.602 174 170.347 50 57.0496 38 45.2488 105 105 
102 210 113 112.193 174 170.746 50 56.3749 38 45.5633 105 105 


6. IMPLEMENTATION OF COLOR DETECTION 

As shown in Figure 6, the robot arm detects a red object with the help of a webcam. Next, the robot 
picks up the object and moves it in the space provided. Experimental results show that the robot arm is 
capable of performing its tasks to detect colored objects, retrieve and move objects by control system using 
ANFIS. When compared with some literature [18-23], the results of this study indicate a better level of 
accuracy. 





(a) Find colored object (b) Pick colored object 





(c) Place colored object 


Figure 6. Experimental result of the arm robot 


7. CONCLUSION 

In this work, ANFIS has been utilized to obtain the solution of inverse kinematic problem of 5 DOF 
robot arm. In this approach, invers kinematics relations of robot are used to obtain the data for training of 
ANFIS. Image processing been processed by algorithm based on MATLAB to detection of colored object. 
Finally, the implementation of red color detection and coordinate to control 5 DoF of Robot Arm based on 
Arduino microcontroller works effective to take and place the colored object. 


Colored object detection using 5 dof robot arm based adaptive neuro-fuzzy method (Mujiarto) 


298 O ISSN: 2502-4752 


ACKNOWLEDGEMENT 
This project is partially funded by the Research Management, Innovation & Commercialization 
Center, Universiti Sultan Zainal Abidin. 


REFERENCES 

[1] E. Ebrahimi and K. Mollazade. “Intelligent fault classification of a tractor starter motor using vibration monitoring 
and adaptive neuro-fuzzy inference system”. Insight-Non-Destructive Testing and Condition Monitoring, Vol. 52, 
No. 10, (2010), pp. 561-566. 

[2] D. Skarlatos, K. Karakasis and A. Trochidis. “Railway wheel fault diagnosis using a fuzzy-logic method”. Applied 
Acoustics, Vol. 65, No. 10, (2004), pp. 951-966. 

[3] K. Mollazade, H. Ahmadi, M. Omid and R. Alimardani. “An intelligent model based on data mining and fuzzy logic 
for fault diagnosis of external gear hydraulic pumps”. /nsight-Non-Destructive Testing and Condition Monitoring, 
51(11), (2009), pp. 594-600. 

[4] L. J. De Miguel and L. F. Blazquez. “Fuzzy logic-based de-cision-making for fault diagnosis in a DC motor”. 
Engineer-ing Applications of Artificial Intelligence, Vol. 18, No. 4, (2005), pp. 423-450. 

[5] S. Bhattacharyya, D. Basu, A. Konar and D. N. Tibarewala. Interval type-2 fuzzy logic based multiclass ANFIS 
algorithm for real-time EEG based movement control of a robot arm. Robotics and Autonomous Systems, Vol. 68, 
(2015), pp. 104-115. 

[6] K. Ucak, F. Caliskan and G. Oke. Fault diagnosis in a non-linear three-tank system via ANFIS. In Electrical and 
Elec-tronics Engineering (ELECO), 2013 8th International Con-ference on IEEE. (2013), pp. 566-570. 

[7] M. Hosoz, H. M. Ertunc, M. Karabektas and G. Ergen. “ANFIS modelling of the performance and emissions of a 
diesel engine using diesel fuel and biodiesel blends”. Applied Thermal Engineering, Vol. 60, No. 1, (2013), pp. 24- 
32; 

[8] S.H. Azadi, H. R. Nedamani and R. Kazemi. “Automatic Parking of an Articulated Vehicle Using ANFIS”. Global 
Journal of Science, Engineering and Technology, Vol. 14, (2013), pp. 93-104. 

[9] P. Mitra, S. Maulik, S. P. Chowdhury and S. Chowdhury. “ANFIS based automatic voltage regulator with hybrid 
learning algorithm’. In Universities Power Engineering Conference, 2007. UPEC 2007. 42nd International IEEE, 
(2007), pp. 397-401. 

[10] K. C. Schurter and P. N. Roschke. “Fuzzy modeling of a magnetorheological damper using ANFIS”. In Fuzzy 
Systems, 2000. FUZZ IEEE 2000. The Ninth IEEE International Conference on IEEE, Vol. 1, (2000), pp. 122-127. 

[11] L. Yingjie and W. Baoshu. “Study on the control course of ANFIS based aircraft auto-landing”. Journal of Systems 
Engineering and Electronics, Vol. 16, No. 3, (2005), pp. 583-587. 

[12] H. Baseri and G. Alinejad. “ANFIS modeling of the surface roughness in grinding process”. World Academy of 
Science, Engineering and Technology, International Journal of Me-chanical, Aerospace, Industrial, Mechatronic 
and Manufacturing Engineering, Vol. 5, No. 1, (2011), pp. 75-79. 

[13] J. Singh and S. S. Gill. “Modelling for tensile strength of friction welded aluminium pipes by ANFIS”. International 
Journal of Intelligent Engineering Informatics, Vol. 1, No. 1, (2010), pp. 3-20. 

[14] A. B. Muljono, I. M. Ginarsa, I. M. A. Nrartha, A. Dharma. “Coordination of Adaptive Neuro Fuzzy Inference 
System (ANFIS) and Type-2 Fuzzy Logic System-Power System Stabilizer (T2FLS-PSS) to Improve a Large-scale 
Power System Stability”. International Journal of Electrical and Computer Engineering(IJECE). Vol. 8, No. 1, 
(2018), pp. 76-86. 

[15] D. Mlakic, L. Majdandzic, S. Nikolovski. “ANFIS used as a Maximum Power Point Tracking Algorithm for a 
Photovoltaic System”. International Journal of Electrical and Computer Engineering(IJECE). Vol. 8, No. 2, (2018), 
pp. 867-879. 

[16] M.S. A. Aziz, M. Elsamahy, M. A. M. Hassan and F. Bendary. A Secure ANFIS based Relay for Turbo-Generators 
Phase Backup Protection. Indonesian Journal of Electrical Engineering and Computer Science(IJECE). Vol. 3, No. 
2, (2016), pp. 249-263. 

[17] B. Ferdi, S. Dib, B. Berbaoui, R. Dehini. Design and Simulation of Dynamic Voltage Restorer Based on Fuzzy 
Controller Optimized by ANFIS. /nternational Journal of Power Electronics and Drive SystemIJEPEDS). Vol. 4, 
No. 2, (2014), pp. 212-222. 

[18] M. O. Efe. “Fractional fuzzy adaptive sliding-mode control of a 2-DOF direct-drive robot arm”. IEEE Transactions 
on Systems, Man, and Cybernetics, Part B (Cybernetics), Vol. 38, No. 6, (2008), pp. 1561-1570. 

[19] A. F. Amer., E. A. Sallam and W. M. Elawady. “Adaptive fuzzy sliding mode control using supervisory fuzzy 
control for 3 DOF planar robot manipulators”. Applied Soft Compu-ting, Vol. 11, No. 8, (2011), pp. 4943-4953. 

[20] F. Pierrot., V. Nabat., O. Company., S. Krut and P. Poignet. “Optimal design of a 4-DOF parallel manipulator: From 
ac-ademia to industry”. IEEE Transactions on Robotics, Vol. 25, No. 2, (2009), pp. 213-224. 

[21] A. Lotfazar., M. Eghtesad and M. Mohseni. “Integrator backstepping control of a 5 DoF robot manipulator incorpo- 
rating actuator dynamics”. In Control Applications, 2003. CCA 2003. Proceedings of 2003 IEEE Conference. Vol. 
2, (2003), pp. 1007-1012. 

[22] S. Alavandar and M. J. Nigam. “Adaptive Neuro-Fuzzy In-ference System based control of six DOF robot 
manipulator”. Journal of Engineering Science & Technology Review, Vol. 1, No. 1, (2008), pp. 106-111. 

[23] S. Klanke., D. Lebedev., R. Haschke., J. Steil and H. Ritter. “Dynamic path planning for a 7-dof robot arm’. In 
Intelligent Robots and Systems, 2006 IEEE/RSJ International Conference. (2006), pp. 3879-3884. 

[24] V. S. Kumar, S. Aswath., T. S. Shashidhar and R. K. Choudhary. “A Novel Design of a Full Length Prosthetic 


Indonesian J Elec Eng & Comp Sci, Vol. 13, No. 1, January 2019 : 293 — 299 


Indonesian J Elec Eng & Comp Sci ISSN: 2502-4752 = 299 


Robotic Arm for the Disabled’. In Robot Intelligence Tech-nology and Applications 4. Vol. 447, (2017), pp. 271- 
287. 

[25] N. Kapoor and J. Ohri. “Sliding Mode Control (SMC) of Robot Manipulator via Intelligent Controllers”. Journal of 
The Institution of Engineers: Series B, Vol. 98, No. 1, (2017), pp. 83-98. 

[26] A. Sambas, S. Vaidyanathan, M. Mamat, W. S. M. Sanjaya and D. S. Rahayu. “A 3-D Novel Jerk Chaotic System 
and Its Application in Secure Communication System and Mobile Robot Navigation’. Studies in Computational 
Intelligence. Vol. 636, (2016), pp. 283-310. 

[27] J. S. Jang. “ANFIS: adaptive-network-based fuzzy inference system’. [EEE transactions on systems, man, and cy- 
bernetics, Vol. 23, No. 3, (1993), pp. 665-685. 


[28] J. G. Juang., Y. J. Tsai and Y. W. Fan. “Visual recognition and its application to robot arm control”. Applied 
Sciences, Vol. 5, No. 4, (2015), pp. 851-880. 


Colored object detection using 5 dof robot arm based adaptive neuro-fuzzy method (Mujiarto) 


